o 
o 
o 

(N 

en 



-(— > 

a 
> 



Nielsen zeta function, 3-manifolds and asymptotic 
expansions in Nielsen theory 

Alexander Fel'shtyn* 



Introduction 



C/^ I Before moving on the results of the paper, we briefly describe the few basic notions 

h-H I of Nielsen fixed point theory which will be used. We assume X to be a connected, 

^ ' compact polyhedron and / : X ^ X to be a continuous map. Let p : X ^ X he the 

cd ■ universal cover of X and f : X ^ X a lifting of /, ie. p ^ f = f o p. Two liftings / 

and /' are called conjugate if there is a 7 G F = 7ri(X) such that /' = 7 o / 07^^. The 
subset p{Fix{f)) C Fix{f) is called the fixed point class of f determined by the lifting 
CN I class [/]. Two fixed points xq and xi of / belong to the same fixed point class iff there 

is a path c from xq to xi such that c = / o c ( homotopy relative endpoints). This fact 
CN ■ can be considered as an equivalent definition of a non-empty fixed point class. Every 

map / has only finitely many non-empty fixed point classes, each a compact subset 
of X. 

A fixed point class is called essential if its index is nonzero. The number of lifting 
classes of / (and hence the number of fixed point classes, empty or not) is called the 
Reidemeister Nunaber of /, denoted R{f)- This is a positive integer or infinity. The 
number of essential fixed point classes is called the Nielsen number of /, denoted by 

N{f). 

The Nielsen number is always finite. R{f) and N{f) are homotopy invariants. In 
r> ' the category of compact, connected polyhedra the Nielsen number of a map is, apart 

c^ ■ from in certain exceptional cases, equal to the least number of fixed points of maps 

with the same homotopy type as /. 

Taking a dynamical point on view, we consider the iterates of /, and we may define 
several zeta functions connected with Nielsen fixed point theory (see |^, ^ |^). The 
Nielsen zeta function of / is defined as power series: 
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The Nielsen zeta function Nf{z) is homotopy invariant. The function Nf{z) has a 
positive radius of convergence which has a sharp estimate in terms of the topological 
entropy of the map / [0]. 

We begin the article by proving in Section 1 that the Nielsen zeta function is a 
rational function or a radical of a rational function for orientation preserving homeo- 
morphisms of special Haken or special Seifert 3-manifolds. 

In Section 2, we obtain an asymptotic expansion for the number of twisted conju- 
gacy classes or for the number of Nielsen fixed point classes whose norm is at most x 
in the case of pseudo-Anosov homeomorphism of surface. 

The author would like to thank M. Gromov, Ch. Epstein, R. Hill, L. Potyagailo, 
R. Sharp, V.G. Turaev for stimulating discussions. In particular, Turaev proposed 
the author in 1987 the conjecture that the Nielsen zeta function is a rational function 
or a radical of a rational function for homeomorphisms of Haken or Seifert manifolds. 

1 Nielsen zeta function and homeomorphisms of 
3-manifolds 

1.1 Periodic maps and homeomorphisms of hyperboHc man- 
ifolds 

We prove in corollary 1 of this subsection that the Nielsen zeta function is a radical of 
rational function for any homeomorphism of a compact hyperbolic 3-manifold. Lemma 
1 and corollary 1 play also important role in the proof of the main theorem of this 
section. 

We denote N{f"-) by A^„. We shall say that / : X ^ X is a periodic map of period 
m, if /™ is the identity map idx : X ^ X. Let ^{d), d & N, he the Mobius function 
of number theory. As is known, it is given by the following equations: fi{d) = if d is 
divisible by a square different from one ; fi{d) = (—1)'^ if c? is not divisible by a square 
different from one , where k denotes the number of prime divisors of d; /^(l) = 1. 

We give the proof of the following key lemma for the completeness. 

Lemma 1 j^ Let f be a periodic map of least period m of the connected compact 
polyhedron X . Then the Nielsen zeta function is equal to 



d\m 

where the product is taken over all divisors d of the period m, and P{d) is the integer 

P{d) = Y.fi{d,)Na\d,. 

di\d 

Proof Since f"^ = id, for each j,Nj = Nm+j- If {k,m) = 1, then there exist 
positive integers t and q such that kt = mq + 1. So (f'^Y = Z'^* = /™''?+^ = /™^/ = 
W^Yf = /• Consequently, N{{f^y) = N{f). Let two fixed point Xq and Xi belong 



to the same fixed point class. Then there exists a path a from xq to x\ such that 
a* {f o a)~^ ~ 0. We have f{a * / o o;)"^) = {f o a) * {p o a)"^ ~ and a product 
a*{f oaY^* {f oa)* (poa)"^ = a* (poa)^^ ~ 0. It follows that a* {f^ oa)~^ ~ 
is derived by the iteration of this process. So Xq and xi belong to the same fixed 
point class of /^. If two point belong to the different fixed point classes /, then 
they belong to the different fixed point classes of f^ . So, each essential class( class 
with nonzero index) for / is an essential class for f^\ in addition , different essential 
classes for / are different essential classes for f^. So N{f^) > N{f). Analogously, 
N{f) = iV((/^)*) > N{f^). Consequently , A^(/) = N{f''). One can prove completely 
analogously that A^^ = N^i, if (i, m/d) =1, where rf is a divisor of m. Using these series 
of equal Nielsen numbers, one can regroup the terms of the series in the exponential of 
the Nielsen zeta function so as to get logarithmic functions by adding and subtracting 
missing terms with necessary coefficient. We show how to do this first for period 
m = p\ where p is a prime number . We have the following series of equal Nielsen 
numbers: 

A^i = Nk,{k,p^) = l{i.e.,noNip,Nip2, ,Nipi,i = 1,2,3, ....), 

Np = N2p = Nsp = = A^(p^i)p = iV(p+i)p = ■■■{noNip2,NipS, ..., Nipi) 

etc.; finally, 

Npi-i = N2pi-i = {noNipi) 

and separately the number Npi. 
Further, 



^ ^ {Np2 - {Np - Ni) - ATQ zP'' 



i=l p ^ 

oo 

+ E 



oo (iv, -...-(iVp-ivo-iVi)zp'' 



i=i p^ i 

= -N, ■ log(l -z) + -^ ^ ■ log(l - zP) + 

P 

N - N 2 9 

Npi-1 - Npi I 

+ —^ ; ^ -log^l - 2;'' ). 

pi 



For an arbitrary period m , we get completely analogously. 



Nf{z) = exp(f:^z^^ 

\d\m t=i- 



\d\m 



n ^(1 - z'^yn^) 

dim 



where the integers P{d) are calculated recursively by the formula 

P{d) = Nd- Y. P(di). 

di\d;dij^d 

Moreover, if the last formula is rewritten in the form 

N, = Y,^{d,)-P{di) 

di\d 

and one uses the Mobius Inversion law for real function in number theory, then 

di\d 

where fi{di) is the Mobius function in number theory. The lemma is proved. 

Corollary 1 Let f : M" -^ M", n > 3 be a homeomorphism of a compact hyperbolic 
manifold. Then by Mostow rigidity theorem f is homotopic to periodic homeomor- 
phism g. So lemma 1 applies and the Nielsen zeta function Nf{z) is equal to 



Njiz) = N,iz) = Y[{/{l-z'^)-^('^), 

d\m 

where the product is taken over all divisors d of the least period m of g, and P{d) is 
the integer P{d) = Ed,|d/i(c?i)A^(/l''0- 

The proof of the following lemma is based on Thurston's theory of homeomor- 
phisms of surfaces []TB|. 



Lemma 2 /Q/ 

The Nielsen zeta function of a homeomorphism f of a compact surface F is either 
a rational function or the radical of a rational function. 

Proof The case of a surface with x{P) > ^^^id case of torus were considered in 
[0]. If surface has x{P) = ^"^^ P is not a torus then any homeomorphism is isotopic 
to periodic one (see |]TT|) and Nielsen zeta function is a radical of rational function by 
lemma 1 . In the case of a hyperbolic {x{F) < 0) surface , according to Thurston's 
classification theorem, the homeomorphism / is isotopic either to a periodic or a 
pseudo-Anosov, or a reducible homeomorphism. In the first case the assertion of the 
lemma follows from lemma 1. If / is an pseudo-Anosov homeomorphism of a com- 
pact surface then for each n > 0, iV(/") = F(/") [^. Consequently, in this case the 
Nielsen zeta function coincides with the Artin-Mazur zeta function: Nf{z) = Ff{z). 



Since in [|] Markov partitions are constructed for a pseudo-Anosov homeomorphism, 
Manning's proof |TE[ of the rationality of the Artin-Mazur zeta function for diffeo- 



morphisms satisfying Smale's axiom A carries over to the case of pseudo-Anosov 
homeomorphisms. Thus , the Nielsen zeta function Nf{z) is also rational. Now if / 
is isotopic to a reduced homeomorphism (j), then there exists a reducing system S of 
disjoint circles Si, S2, ■■■, Sm on intF such that 

1) each circle Si does not bound a disk in F; 

2) Si is not isotopic to Sj,i 7^ j; 

3) the system of circles S is invariant with respect to 0; 

4) the system S has an open 0-invariant tubular neighborhood f]{S) such that each 
-component Tj of the set F — r]{S) is mapped into itself by some iterate cjf'^nj > 
of the map 0; here 0"^ on Tj is either a pseudo-Anosov or a periodic homeomorphism; 

5) each band 77(5'^) is mapped into itself by some iterate (jf^^rrii > 0; here 0™' on 
ri{Si) is a generalized twist (possibly trivial). 

Since the band //(S*,) is homotopically equivalent to the circle S^ the Nielsen zeta 
function Nft,m(z) is rational (see M). The zeta functions NJz) and N^m(z) are con- 



nected on the - component Tj by the formula N^{z) = y/N^n(^z'^j)-^ analogously, on 



the band ri{Si),N^{z) = "}o/N^^{z"^3y The fixed points of 0", belonging to different 

components Tj and bands ri{Si) are nonequivalent [^, so the Nielsen number N{(f)^) is 
equal to the sum of the Nielsen numbers Nlcp^/Tj) and N{(j)^/rj{Si)) of -components 
and bands . Consequently, by the properties of the exponential, the Nielsen zeta func- 
tion N^{z) = Nf{z) is equal to the product of the Nielsen zeta functions of the 0- 
components Tj and the bands ri{Si), i.e. is the radical of a rational function. 

1.2 Homeomorphisms of Seifert fibre spaces 

Let M be a compact 3-dimensional Seifert fibre space. That is a space which is foliated 
by simple closed curves, called fibres, such that a fibre L has a neighborhood which 
is either a solid Klein bottle or a fibred solid torus T^, where r denotes the number 
of times a fibre near L wraps around L. A fibre is regular if it has neighborhoods 
fibre equivalent to solid torus 5*^ x D^, otherwise it is called a critical fibre. There 
is a natural quotient map p : M -^ F where F is a 2-dimensional orbifold, and 
hence, topologically a compact surface. The projection of the critical fibres, which we 
denote by S, consists of a finite set of points in the interior of F together with a finite 
subcoUection of the boundary components. The reader is referred to |T^ for details. 



for definitions about 2-dimensional orbifolds, their Euler characteristics and other 
properties of Seifert fibre spaces. An orbifold is hyperbolic if it has negative Euler 
characteristic. Hyperbolic orbifold admits hyperbolic structure with totally geodesic 



boundary. 

Any fibre-preserving homeomorphism f : M -^ M naturally induces a relative 
surface homeomorphism of the pair {F,S), which we will denote by /. Recall from 
[ P^ that there is a unique orientable Seifert fibre space with orbifold P{2, 2) -projective 
plane with cone singular points of order 2, 2. We denote this manifold by Mp(2,2)- 



Lemma 3 / (7^ , [i7|/ Suppose M is a compact orientable Seifert fiber space which is 
not T'^, S-^ X D^,T^ x I or Mp(2,2)- Then there is a Seifert fibration p : M ^ F , so 
that any orientation preserving homeomorphism on M is isotopic to a fiber preserving 
homeomorphism with respect to this fibration. 

Observe that if M and F are both orientable, then M admits a coherent orientation 
of all of its fibres and the homeomorphism / either preserves fibre orientation of all 
the fibres or it reverses fibre orientation. 



Lemma 4 / [7^/ Let M be a compact, orientable aspherical, 3-dimensional Seifert fibre 
space such that the quotient orbifold F is orientable and all fibres have neighborhoods 
of type Ti. Let f : M ^ M be a fibre-preserving homeomorphism inducing f : F —>■ F. 
If f preserves fibre orientation, then Nielsen number N{f) = 0. // / reverses fibre 
orientation, then N{f) = 2N{f). 

Proof First, by small isotopy, arrange that / has a finite number of fibres which 
are mapped to themselves. If / preserves fibre orientation a further isotopy, which 
leaves / unchanged, ensures that none of these fibres contains a fixed point. Thus, 
Fix (/) = and so, A^(/) = 0. If / reverses fibre orientation there are exactly 2 fixed 
points on each invariant fibre. Since M is aspherical lemma 3.2 in [|1^ ensures that for 



any invariant fibre the 2 fixed points on that fibre are in distinct fixed point classes. 
On the other hand, the restriction on the fibre types in the hypothesis implies that 
a Nielsen path in F can always be lifted to a Nielsen path path in M. In fact, there 
will be two distinct lifts of each path in F. As a result, / has two fixed point classes 
covering each fixed point class of /. Since the index of a fixed point class of / is the 
same as that of its projection under p the result follows. 

Remark 1 As one can see lemma deals with a restricted class of Seifert fibre space. 
M. Kelly gave some examples in \T^] which indicate how critical fibres of Seifert fibre 
space effect Nielsen classes in the case when r > 1 in Ty. and which difficulties arise 
in this case. 



Definition 1 A special Seifert fibre space is a Seifert fiber space such that the quotient 
orbifold F is orientable and all fibres have neighborhoods of type Ti . 



Theorem 1 Suppose M is a closed orientable aspherical manifold which is a special 
Seifert fibre space and f : M ^ M is an orientation preserving homeomorphism. 
Then the Nielsen zeta function Nf{z) is a rational function or a radical of a rational 
function. 



Proof If / preserves fibre orientation, then /" also preserves fibre orientation and 
so, by lemma 4 Nielsen numbers N{f^) = for all n and the Nielsen zeta function 
Nf{z) = 1. If / reverses fibre orientation , then /^ preserves fibre orientation, /^ 
reverses fibre orientation and so on. Thus, we have N{f'^^^^) = 2N{p^^^) and 
N{.P^) = for A; = 0, 1, 2, ... . As result, the Nielsen zeta function Nf{z) equals 



Kn=l ^ 



OO T\T(f2k+l-) 



exp \Y1 



Nif 
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-z 
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exp ^ 
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= iNjiz)y/Nf,iz'). 

From lemma 2 it follows that Nielsen zeta functions N Az) and N f2{z^) are either 
rational functions or the radicals of rational functions. Consequently, the Nielsen zeta 
function Nf{z) is a rational function or a radical of a rational function. 

1.3 Main theorem 

Basic concepts about 3- manifold topology can be found in [|T0|, in particular the Jaco- 
Shalen- Johannson decomposition of Haken manifolds and Seifert fiber spaces. See ||18| 



for discussions on hyperbolic 3-manifolds. We recall some basic facts about compact 
connected orientable 3-manifolds. A 3-manifold M is irreducible if every embedded 
2-sphere bounds an embedded 3-disk. By the sphere theorem P], an irreducible 3- 
manifolds is a K{tt, 1) Eilenberg-MacLane space if and only if it is a 3-disk or has 
infinite fundamental group. 

A properly-embedded orientable connected surface in a 3-manifold is incompress- 
ible if it is not a 2-sphere and the inclusion induces a injection on the fundamental 
groups. An irreducible 3-manifold is Haken if it contains an embedded orientable 
incompressible surface. We use notation N{X) to denote a regular neighborhood of 
set X. A Haken 3-manifold M can be decomposed along a canonical set T of incom- 
pressible tori into pieces such that each component of M — N{T) is either hyperbolic 
manifold, or twisted /-bundle over Klein bottle, or a Seifert fiber space with hyper- 
bolic orbifold. This decomposition is called Jaco-Shalen- Johannson decomposition. 



Definition 2 A special Haken manifold is a Haken manifold M such that each com- 
ponent of M — N{T) in JSJ decomposition of M is either hyperbolic manifold, or 



a twisted I -bundle over Klein bottle, or a aspherical special Seifert fiber space with 
hyperbolic orbifold. 



We need some definitions from tlie paper [[Ll[] . 

Definition 3 Suppose f : M ^ M is a map, and A, B are f -invariant sets of M. If 
there is a path 7 from A to B such that ■j r^ f o 'j rel {A, B), then we say that A, B 
are f -related. 

Definition 4 Suppose M is a compact 3-manifold with torus boundaries. A map 
f : M —^ M is standard on boundary if for any component T of DM , the map f /T is 
one of the following types: (1) a fixed point free map; (2) a periodic map with isolated 
fixed points; (3) a fiber preserving, fiber orientation reversing map with respect to some 
S^ fibration ofT. 

Definition 5 A map f on a compact 3-manifold M is said to have FR-property( fixed- 
point relating property) if the following is true: if A & Fix(f ) and B is either a fixed 
point of f or an f -invariant component of DM , and A, B are f -related by a path 7, 
then 7 is A,B homotopic to a path in Fix(f ) . 



Definition 6 A map f is a type I standard map if (1) f has FR-property, (2) f is 
standard on boundary, (3) Fix(f ) consists of isolated points, and (4) f is of flipped 
pseudo-anosov type at each fixed point. A map f is type II standard map if it satisfies 
(1), (2) above, as well as (3) Fix(f ) is a properly embedded 1-dimensional submanifold 
and (4) f preserves a normal structure on Fix(f). 

The main result of tliis section is tlie following theorem. 

Theorem 2 Suppose M is a closed orientable manifold which is special Haken mani- 
fold, and f : M ^ M is an orientation preserving homeomorphism. Then the Nielsen 
zeta function Nf{z) is a rational function or a radical from rational function. 

Proof Let T be (possibly empty) set of invariant tori of the JS J decomposition of 
M . Then each component oi M — IntN{T) is either hyperbolic manifold, or a twisted 
/-bundle over Klein bottle, or a aspherical special Seifert fiber space with hyperbolic 
orbifold. Isotop / so that it maps N(T) homeomorphically to itself. Suppose that 
P is a Seifert fibered component of M — IntN{T) such that f{P) = P. By | ]17| |, 



f /P is isotopic to a fiber preserving map. Recall that a torus T in M is a vertical 
torus if it is union of fibers in M. By [rT| lemma 1.10, we can find a set of vertical 



tori T* in P, cutting P into pieces which are either a twisted /-bundle over Klein 
bottle, or have hyperbolic orbifold, and a fiber preserving isotopy of /, so that after 
isotopy, the restriction of / on each invariant piece has periodic or pseudo-Anosov 
orbifold map. Adding all such T* to T, we get a collection of tori T', such that : 
(1) f{N{r') = J\f{T'); (2) each component M^ of M - IntN{T') either ist a twisted 
/-bundle over Klein bottle or has hyperbolic orbifold; (3) If / maps a Seifert fibered 



component Mi to itself, and if Mj has hyperbolic orbifold, then / is fiber preserving, 
and the orbifold map / on Fi is either periodic or pseudo-Anosov. By [^ we can 
isotop / so that restriction //Mj is a standard map for all Mi and after that we can 
further isotop /, rel dNj, on each component Nj of N{T'), so that it is a standard 
map on Nj. By the definition of standard maps, Fix(f) intersects each of M, and Nj 
in points and 1-manifolds, so Fix(f) is a disjoint union of points, arcs, and circles. 
Jiang, Wang and Wu proved p!l[] theorem 9.1 that different components of Fix(f) are 
not equivalent in Nielsen sense. We repeat their proof here for the completeness. If 
exist two different components Co, Ci of Fix(f ) which are equivalent, then there is 
a path a connecting Co, Ci such that / o a ~ a rel (9. Denote by T" the set of 
tori dN{T'). Among all such a, choose one such that the number of components 
tl(a — T") of the set a — T" is minimal. In below we will find another such curve a" 
with ^{a" — T") < tj(« — T"), which would contradict the choice of a. Let D be a 
disk, and let h : D ^ M be a homotopy f o a ^ a rel d. We may assume that h is 
transverse to T", and ]^h^^(T") is minimal among all such h. Then h^^(T") consists 
of a properly embedded 1-manifold on D, together with possibly one or two isolated 
points mapped to the ends of a. T" is vri-injective in M , so one can modify h to 
remove all circles in h~^{T"). Note that h~^{T") must contain some arcs, otherwise 
a would lie in some Mi or N{Tj), which is impossible because the restriction of / 
in each piece has FR-property. Now consider an outermost arc b in h^^{T") . Let 
(3 = h{b). The ends of j3 can not both be on a, otherwise we can use the outermost 
disk to homotope a and reduce tl(a; — T"), contradicting the choice of a. Since / is 
a homeomorphism, the same thing is true for f o a. Therefore, f3 has one end on 
each of a and f ■ a. The arc b cutt off a disk A on D whose interior is disjoint from 
h~^(T"). The boundary of A gives rise to a loop h{dA) = ai U /5 U (/ o a;i)~\ where 
«! is subpath of a starting from an end point x oi a. let T be the torus in T" which 
contains /3. Then the restriction of /i on A gives a homotopy ai ~ / ■ ai rel(x,T). 
Since / has FR-property on each component oi M — IntN{T) and N{T), by definition 
there is a path 7 in Fix(f) such that 7 ~ ai rel (x, T). Since 7 is in Fix(f), the path 
a' = 'y~^ -a has the property that foa' = (foj^^)- (/oa) = 7~^-(/oq;) ~ •y^^-a = a' 
rel d. Since ai ~ 7 rel (x,T), the path 7"^ ■ ai is rel d homotopic to a path 6 on 
T. Write a = ai ■ 02- Then a' = '~f~^ ■ a = {'-f~^ ■ ai) ■ 0:2 ~ 5 ■ 0:2 rel d. By a small 
perturbation on 6, we get a path a" ~ a' rel d such that tl(a;" — T") < tl(a — T"). 
Since / o a" ~ / o a' ~ a' ~ a" rel d, this contradicts the minimality of tl(tt — T"). 

We can prove in the same way that the fixed points of an each iteration /", be- 
longing to different components M, and Nj are nonequivalent , so the Nielsen number 
N{f"^) equals to the sum of the Nielsen numbers N{f"'/Mi) and N{f"^/Nj) of compo- 
nents . Consequently, by the properties of the exponential, the Nielsen zeta function 
Nf{z) is equal to the product of the Nielsen zeta functions for the induced homeo- 
morphisms of the components Mj and Nj. By corollary 1 the Nielsen zeta function 
of the hyperbolic component Mj is a radical of a rational function. The Nielsen zeta 
function is a radical of a rational function for the component Mi which is a aspherical 
special Seifert fibre space by the theorem 1 . The Nielsen zeta function is a rational 
function or a radical of a rational function for a homeomorphism of torus or Klein 
bottle by lemma 2 . This implies that the Nielsen zeta function is a rational func- 
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tion or a radical of a rational function for the induced homeomorphisni of component 
Nj which is /-bundle over torus and for the induced homeomorphisni of component 
Mi which is twisted I-bundle over Klein bottle. So, the Nielsen zeta function Nf{z) 
of the homeomorphisni / of the whole manifold M is a rational function or a radi- 
cal of a rational function as a product of the Nielsen zeta functions for the induced 
homeomorphisms of the components Mi and Nj. 

2 Asymptotic expansions for fixed point classes 
and twisted conjugacy classes of pseudo-Anosov 
homeomorphisni 

2.1 Twisted conjugacy and Reidemeister Numbers. 

Let r be a group and : F — > F an endomorphism. Two elements a,a' E T are said 
to be — conjugate iff there exists 7 e F with 

a' = 70:0(7)""^. 

We shall write {x}^ for the 0-conjugacy class of the element x G F. The number of 
0-conjugacy classes is called the Reidemeister number of 0, denoted by R{(p). If is 
the identity map then the 0-conjugacy classes are the usual conjugacy classes in the 
group F. 

In P] we have conjectured that the Reidemeister number to be infinite as long as 
the endomorphism is injective and group has exponential growth. Below we prove 
this conjecture for surface groups and pseudo-Anosov maps and, in fact, we obtain an 
asymptotic expansion for the number of twisted conjugacy classes whose norm is at 
most X. 

Let / : X — i> X be given, and let a specific lifting / : X — i> X be chosen as 
reference. Let F be the group of covering translations of X over X. Then every lifting 
of / can be written uniquely as 70/, with 7 G F. So elements of F serve as coordinates 
of liftings with respect to the reference /. Now for every 7 G F the composition /07 is 
a lifting of / so there is a unique 7' G F such that 7' o / = / o 7. This correspondence 
7 — > 7' is determined by the reference /, and is obviously a homomorphism. 

Definition 7 The endomorphism /* : F ^ F determined by the lifting f of f is 
defined by 

f*h)° f = f°7- 

It is well known that F = 7ri(X). We shall identify vr = 7ri(X, xq) and F in the 
following way. Pick base points Xq E X and Xq G p~^{xo) C X once and for all. Now 
points of X are in 1-1 correspondence with homotopy classes of paths in X which start 
at Xq: for X G X take any path in X from xq to x and project it onto X; conversely 
for a path c starting at xq, lift it to a path in X which starts at xq, and then take its 
endpoint. In this way, we identify a point of X with a path class < c > in X starting 
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from xq. Under this identification, xq =< e > is the unit element in 7ri(X, xq). The 
action of the loop class a =< a >E 7ri(X, Xq) on X is then given by 

a =< a >:< c >-^ a ■ c =< a ■ c> . 

Now we have the following relationship between /* : vr ^ vr and 

/^ : TTi{X, xo) — > ni{X, /(xq)). 

Lemma 5 Suppose /(xq) =< w >. Then the following diagram commutes: 

7ri(X,a;o) -^ 7ri(X, /(xq)) 

7ri(X,Xo) 
where w* is the isomorphism induced by the path w. 

In other words, for every a =< a >E 7ri(X, xq) , we have 

/*(< a >) =< w{f o a)w~^ > 

Remark 2 In particular, if Xq G p{Fix{f)) and Xq G Fix{f),then f^ = f^.. 

Lemma 6 Lifting classes of f ( and hence fixed point classes, empty or not) are in 1-1 
correspondence with f,,-conjugacy classes in n, the lifting class [7 o /] corresponding 
to the f^:-conjugacy class of 'y. We therefore have R{f) = R{f*)- 

We shall say that the fixed point class p{Fix{'~f of)), which is labeled with the 
lifting class [70/], corresponds to the /*-conjugacy class of 7. Thus /*-conjugacy 
classes in n serve as coordinates for fixed point classes of /, once a reference lifting / 
is chosen. 

2.2 Asymptotic expansions 

We assume X to be a compact surface of negative Euler characteristic and f : X ^ X 
is a pseudo-Anosov homeomorphism, i.e. there is a number A > 1 and a pair of 
transverse measured foliations (F*, yu'*) and (F",/i") such that /(F'',/i*) = {F^,jfi^) 
and f{F'^,iJi^) = (F",A;u"). The mapping torus Tf oi f : X -^ X is the space 
obtained from X x [0, 1] by identifiing {x, 1) with {f{x), 0) for all a; G X. It is often 
more convenient to regard Tj as the space obtained from X x [o, 00) by identifiing 
{x, s + 1) with {f{x), s) for all x G X, s G [0, 00). On Tj there is a natural semi-flow 
(f) : Tf X [0, 00) -^ Tf, (f)t{x, s) = {x,s + t) for all t > 0. Then the map / : X ^ X 
is the return map of the semi-flow 0. A point x & X and a positive number r > 
determine the orbit curve 0(a;,r) '■= 0t(2^)o<t<T ^^ '^f- "^^^ fixed points and periodic 
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points of / then correspond to closed orbits of various periods. Take the base point 
Xq of X as the base point of Tf. According to van Kampen Theorem the fundamental 
group G := 7ii(Tf,Xo) is obtained from vr by adding a new generator z and adding 
the relations z~^gz = f^{g) for al\ g E n = 7ii{X,xo), where z is the generator of 
ni{S^,Xo) This means that G is a semi-direct product G = n (X Z of n with Z. 
We now describe some known results 

Lemma 7 If T is a group and (p is an endomorphism of T then an element x eT is 
always (p-conjugate to its image 0(x). 

Proof. If 7 = x^^ then one has immediately 7X = 0(x)0(7). The existence of a 7 
satisfying this equation implies that x and (f){x) are 0-conjugate. 

Lemma 8 Two elements x,y of it are f ^-conjugate iff xz and yz are conjugate in the 
usual sense in G. Therefore R{f) = R{f*) is the number of usual conjugacy classes 
in the coset tc ■ z of n in G. 

Proof, if X and y are /^-conjugate then there is a 7 G vr such that •yx = |//*(7). 
This implies ■yx = yzyz'^ and therefore ^{xz) = {yz)y so xz and yz are conjugate 
in the usual sense in G. Conversely suppose xz and yz are conjugate in G. Then 
there is a 72;" e G with yz'^xz = yzyz^. From the relation zxz~^ = f*{x) we obtain 
lf*{x)z"'~^^ = yf*{;~i)z'^^^ and therefore 7/"(a;) = yf*{y). Thjs shows that /"(a;) and 
y are /^.-conjugate. However by lemma 7 x and /"(x) are /^-conjugate, so x and y 
must be /^-conjugate. 

There is a canonical projection t : Tj —^ R/Z given by {x, s) i— > s. This induces a 
map 7ri(r) : G = ni{Tf,Xo) —>■ Z. 

We see that the Reidemeister number R{f) is equal to the number of homotopy 
classes of closed paths 7 in Tf whose projections onto R/Z are homotopic to the path 

a : [0, 1] -^ R/Z 

s \-^ s. 

Corresponding to this there is a group theoretical interpretation of R{f) as the 
number of usual conjugacy classes of elements 7 G vri(Tj) satisfying 7ri(r)(7) = z. 

Lemma 9 / [7^ , [7^/ Interior of the mapping torus Int{Tf) admits a hyperbolic struc- 
ture of finite volume if and only if f is isotopic to pseudo-Anosov homeomorphism. 

So, if the surface X is closed and / is isotopic to pseudo-Anosov homeomorphism 
the mapping torus Tf can be realised as a hyperbolic 3-manifold , H'^/G, where H^ 
is the Poincare upper half space {{x,y,z) : z > 0,{x,y) G R^} with the metric 
ds"^ = {dx^ + dy"^ + dz"^)/ z"^. The closed geodesies on a hyperbolic manifold are in one- 
to-one correspondence with the free homotopy classes of loops. These classes of loops 
are in one-to-one correspondence with the conjugacy classes of loxodromic elements 
in the fundamental group of the hyperbolic manifold . This correspondences allow 
Ch. Epstein ( see 0, p. 127) to study the asymptotics of such functions as Pn{,x) = 
^ { primitive closed geodesies of lenght less than x represented by an element of 
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the form gz"" } using the Selberg trace formula. A primitive closed geodesic is one 
which is not an iterate of another closed geodesic. Later, Phillips and Sarnak W5 



generalised results of Epstein and obtained for n-dimensional hyperbolic manifold the 
asymptotic of the number of primitive closed geodesies of length at most x lying in 
fixed homology class. The proof of this result makes routine use of the Selberg trace 
formula. In the more general case of variable negative curvature such asymptotic was 
obtained by PoUicott and Sharp |T^. They used dynamical approach based on the 
geodesic flow. We will only need an asymptotic for pi{x). Note, that closed geodesies 
represented by an element of the form gz are automatically primitive, becouse they 
wrap exactly once around the mapping torus (once around generator z). We have 
following asymptotic expansion [Q, |1^, ^ 



hx N (~i 1 

pi(-) = ^(E^ + o(^)X (1) 



n=0 



for any A^ > 0, where h = dimTy — 1 = 2 is the topological entropy of the geodesic 
flow on the unit-tangent bundle STf, the constant Cq > depend on the volume of 
hyperbolic 3-manifold Tf. N. Anantharaman [jl| has shown that constants C„ vanish 
if n is odd. So, we have following asymptotics 



phx 



Pi{x) ~ Co-^, x ^ oo (2) 

Notation. We write /(x) = g{x) + 0{h{x)) if there exists C > such that 
I f{x) — g{x) |< Ch{x). We write f{x) ~ g{x) if 4|y — i> 1 as x — i> oo 

Now, using one-to-one correspondences in lemma 6 and lemma 8 we define a norm 
of fixed point class, or corresponding to him lifting class, or corresponding to them 
twisted conjugacy class {g}i in the fundamental group of surface vr = 7ii{X,xo) as 
the length of the primitive closed geodesic j on Tf, which represented by an element 
of the form gz. So, for example, the norm function /* on the set of twisted conjugacy 
classes equals I* = I o B, where I is length function on geodesics(Z(7) is the length 
of the primitive closed geodesic 7 ) and B is bijection between the set of twisted 
conjugacy class {g}i in the fundamental group of surface vr = 7ii{X, xq) and the set 
of closed geodesies represented by an elements of the form gz in the fundamental 
group G := 7ri(T/,Xo) . We introduce following counting functions 
FPC(x)= ^ {fixed point classes of / of norm less than x }, 
L(x)= # { lifting classes of / of norm less than x }, 

Tw(x)= #{ twisted conjugacy classes for /* in the fundamental group of surface of 
norm less than x } 

Theorem 3 Let X be a closed surface of negative Euler characteristic and f : X —>■ X 
is a pseudo-Anosov homeomorphism. Then 

2x N /^ -1 

FPC{x) = m = Twix) = ^(E ^ + 0(^)), 

where the constant Co > depend on the volume of hyperbolic 3-manifoldTf, constants 
Cn vanish if n is odd. 
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Proof The proof follows from lemmas 8 and 9 and asymptotic expansion (1). 

Corollary 2 For pseudo-Anosov homeomorphism of surf ace the Reidemeister number 
is infinite. 

We can generalise Theorem 3 in following way 

Theorem 4 Let M be a compact manifold and f : M ^ M is a homeomorphism. 
Suppose that the mapping torus Tf admits a Riemannian metric of negative sectional 
curvatures . Then there exist constants Co, Ci, C2, ... with Cq > such that 



hx N (~< 1 

FPC{x) = L{x) = Twix) = ^(E ^ + 0(^)) 



for any N > 0, where h > is the topological entropy of the geodesic flow on the 
unit-tangent bundle STf and constants Cn vanish if n is odd. 



Question 1 For which compact manifolds M and homeomorphisms f : M ^ M 
the mapping torus Tf admits a Riemannian metric of negative curvature or negative 
sectional curvatures ? 



Question 2 How to define the norm of the fixed point class or twisted conjugacy 
class in general case? Is it exist twisted Selberg trace formula for the discrete group? 
Such formula can give asymptotic expansion of counting function for twisted conjugacy 
classes. 
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